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1 Introduction 

The paper deals with the problem of utility maximization in consumption-investment mod- 
els over a fixed horizon when the current utility depends also on the wealth process. The 
fact that the current utility may depend also on the wealth is motivated by the fact that 
this situation arises in some concrete financial problems, as discussed in Section [6j 

We tackle the problem by duality and using a dynamic programming approach both on 
the primal and on the dual problem. Since the papers by Karatzas, Lehoczky and Shreve 
[19] and by Cox and Huang [7] , the duality approach to consumption-investment problems 
has been extensively treated in the literature (see the survey paper by Rogers [24], and the 
book by Karatzas and Shreve [20^ Ch. 3 and 6] - and the references therein) to treat gen- 
eralizations of the classical Merton problem (incomplete markets, non-Markovian setting, 
strategies constraints, transaction costs, etc.). Notably with regard to our paper, Bouchard 
and Pham [3] treat the case of current utility depending on the wealth in a semimartingale 
setting without developing the dynamic programming approach. 

When the stock is assumed to evolve according to a stochastic differential equation, one 
can apply the dynamic programming machinery both to the primal and the dual problem 
to get some more insights on the solution of the problem. In particular the duality can be 
read at the analytical level of the Hamilton-Jacobi-Bellman (HJB) equation, providing a 
dual equation. This is what is done in Bian, Miao and Zheng [2] (see also the extension 
of such results in [3]) in the case of no current utility on the wealth. But, as far as we 
know, duality has been never employed combined with the dynamic programming when 
the current utility depends on the wealth process. This may be due to the fact that when 
there is no dependence of the current utility on the wealth process the HJB equation 
associated to the dual problem is linear - so approachable by semi-explicit solution written 
in terms of the heat kernel (see [21 [3]) - while when the current utility also depends on 
the wealth such HJB equation is just semi-linear - so more difficult to study. At the level 
of control problems, this corresponds to the fact that in the former case the dual problem 
is simpler, as the control does not appear in it, while in the latter one the dual problem 
is a real control problem (these issues are discussed in Remark 13. ip . Nevertheless, also in 
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this last case, the dual control problem is still simpler to treat than the primal one, as the 
control only appears in the drift of the process, consistently with the fact that the HJB 
equation is semilinear (while the HJB equation associated to the primal control problem is 
fully nonlinear and degenerate, so very difficult to tackle directly by the PDE's theory of 
classical solutions) 

Our method to solve the problem is the following. 

Step 1 : Staring from the original primal problem (with value function V and an asso- 
ciated primal HJB equation), we define a dual problem, which is still a control problem. 

Step 2: We associate to the dual problem a dual HJB equation and prove that the 
value function W of this dual problem is a viscosity solution of the dual HJB equation 
(Proposition 14. 4p . 

Step 3: Since the dual HJB equation is semilinear and nondegenerate, we are able to 
prove good regularity results for W. This is proved in Theorem 14.51 which is the key result 
of the paper. 

Step 4 '■ The regularity W allows to define a smooth solution to the primal HJB equation, 
which is the Legendre transform W of W. 

Step 5: We prove a verification theorem for our primal problem within a suitable class 
C of smooth solutions of the primal HJB equation. Since W € C, this theorem, together 
with a result of existence and uniqueness for the associated closed loop equation, will imply 
that W = V and that V is the unique classical solution of the primal HJB equation within 
the class C. These results will yield also the construction of an optimal feedback control 
for the primal problem. 

The rest of the paper is organized as follows. In Section 2 we set the problem and state 
the assumptions. In Section 3 we define the dual problem (Step 1 above). In Section 4 we 
study the dual HJB equation by a viscosity approach and state the regularity of the value 
function W (Steps 2 and 3 above). In Section 5 we prove that y is a classical solution of 
the HJB equation and provide the optimal feedbacks through a verification theorem (Steps 
4 and 5 above). Finally, Section 6 provides two concrete applications of our framework. 

2 Model and optimal control problem 

In this section we present the financial model and the (primal) stochastic control problem 
we deal with. 

Let us consider a complete filtered probability space {Tt)t>Oi^) satisfying the usual 

conditions, on which is defined a standard Brownian motion {Bt)t>o- We assume that 
{J~t)t>o is the filtration generated by this Brownian motion and enlarged by the P-null sets. 

On this space we consider a riskless asset with deterministic rate of return that without 
loss of generality (see Remark [2.3( ii) below) we set equal to 0, and a risky asset S = {St)t>o 
with dynamics 

dSt = St{b{t)dt + a{t)dBt), 

^We also should mention the paper [23], where the HJB equation associated to the dual problem is again 
fully nonlinear, but admits a semi-explicit solution in the form of a power series. 
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where b, a are deterministic coefficients representing, respectively, the drift and the volatil- 
ity of the risky asset. 

Fix a time horizon T > 0. In the setting above, we define a set of admissible trad- 
ing/consumption strategies in the following way. Consider all the couples of processes 
(c, vr) such that 

(hi) c = ict)t£[o,T] is a real nonnegative process (J"t)fg[o^T]-pi'6dictable and with trajectories 
locally integrable in [0, T); q represents the consumption rate at time t; 

(h2) vr = (vr()jg[o,T] is a real process (-Ft)(g[o ■r]-predictable and with trajectories locally 
square integrable in [0,r); vr^ represents the amount of money invested in the risky 
asset at time t. 

Given a couple (c, vr) satisfying the requirements (hl)-(h2) above, we can consider the 
process Xt representing the wealth associated to such strategy. Its dynamics is 



where xq > is the initial wealth. As class of admissible controls we consider the couples 
of processes (c, vr) satisfying (hl)-(h2) and such that the corresponding wealth process X 
is nonnegative (no-bankruptcy constraint). The optimization problem is 



Let ]R+ := [0,+oo). In the following, given an integer k > 0, a real number 6 > and 
O C open, by Ci^^'^^^ {[0, T) x O; M) we denote the space of real continuous functions on 
[0, r) X O whose space derivatives up to order k exist and are (5/2-Holder continuous with 
respect to t and J-Holder continuous with respect to the space variables on each compact 
subset of [0, T) x O. We make the following assumptions on the model. 

Assumption 2.1 6,0" : [0,T] — )■ M are strictly positive and {5 /2)-Hdlder continuous for 
some 5 G (0, 1]. 

Assumption 2.2 The preference of the agent are described by utility functions Ui, U2 sat- 
isfying the following: 

(i) Ui : [0,T) X M2_ ^ M is such that Ui £ Ci^^'''^\[0,T) x (0, +00) x (0,+oo);M) for 
some k >2 (and the same 5 of A ssumption [Kl]) . For each fixed t S [0, T) the function 
Ui{t,-,-) is concave with respect to (c, x) and nondecreasing with respect to both the 
variables c, x. 



dXt = TTt 

Xq = xo, 




(1) 




(2) 
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Moreover either 



( d 



(a) 



or 



(ii) U2 : M+ 
assume 



^C/i(t,0+,x) = +00, V(t,x) € [0,T) xM+, 



^C/i(t,+oo,x) =0, V(t,x) e [0,r) X M+, 



.if/i>0, ^f/i<0, in [0,r) X (0,+oo) X (0,+oo), 



is continuous, nondecreasing, concave. Without loss of generality we 



U2{0) = 0. 



(3) 



(Hi) The following growth condition holds: there exist K > and p G (0, 1) such that 

Ui{t,c,x) + U2{x) < K{l + cf + xP), V(t,c,x) € [0,T) X M^. (4) 
Moreover, without loss of generality for the optimization problem, we assume that 

Ui{t,0,0) = 0, VtG[0,r). (5) 

(iv) Either 

(a) 3e > such that lim Ui(t,c,0) = +00 uniformly in t S [T — e,T), 



or 



or both. 



(6) lim f/2(x) 



+00 



X— ^+00 



In the remark below we comment on some features of the model and explain when and how 
they can be eventually modified to cover other interesting cases. 

Remark 2.3 (i) In the applications one is often interested to work with power utility 
functions. Assumption \2. ^ includes only the case of positive power. On one hand the case of 
negative exponent is interesting, as it seems to he even more realistic from the point of view 
of the agents ' behavior; on the other hand, it would require a slightly different treatment. 
Just for simplicity, we will work with Assumption \2.S\ nevertheless we stress that the case 
of negative utility can be treated by the same techniques by suitable modifications. 

(ii) The assumption that the riskless rate of return is can be done without loss of 
generality. Indeed, since we are considering a quite general time- dependent Ui, the interest 
rate can be discarded in it by a suitable discounting of the variables (see Rem. 2, p. 189]). 

(Hi) The problem without consumption falls in our setting as well. Indeed, take a prob- 
lem without consumption and with running utility ui{t,x). Defining Ui{t,c,x) = ui{t,x) in 
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our setting, consuming turns out to be not convenient, as its negative effect on the wealth 
has not a trade-off in terms of utility from consumption. In other terms, the optimal con- 
sumption is c^ = 0. As a consequence the problem in our setting with Ui defined as above is 
equivalent to the problem without consumption and with utility function ui . In particular, 
when ui = we fall in the setting of J^. 

(iv) We have set the problem with finite horizon. However, some problems arising in 
the applications - see Section - involve the infinite horizon case, where T = +oo, for 
which the functional usually looks like 



where, as usual for infinite horizon problems, p > is a discount rate sufficiently large 
to guarantee the finiteness of the value function. The results we provide in the present 
paper for the finite horizon case can be suitably generalized to the infinite horizon case, 
with the complication of dealing in the viscosity treatment of the HJB equation with growth 
conditions for t — )• +oo in place of terminal boundary conditions at t = T. We refer, e.g., 
to jll^ for an example of the technical treatment of this kind of conditions and stress here 
that our main results - the regularity results - do not "see" whether the horizon is finite or 
infinite, as they are based on local arguments. Of course, in this case one needs to assume 
that Assumption \2.^ iv) is satisfied at point (a). 

(v) We comment on Assumption \2.2\f i). It requires that either Ui is independent of c 
or it satisfies Inada's conditions with respect to c. We need this assumption to get in a 
straightforward way the regularity of the Legendre transform of Ui with respect to c ( Propo- 
sition I4TIY 6)), which is in turn needed to get the regularity of the dual value function. 



see Section \4-2\ Basically it is thought to cover the case of separable utility in the form 

Ui{t,c,x) = u[^\t, c) + u[^\t,x), where u[^^ is identically or satisfies the Inada condi- 
tions with respect to c, which is the case arising in the applications we have in mind (see 
Section [^. Relaxing this assumption seems possible, but at a price of more demanding 
technical arguments. We prefer to avoid such technicalities in order to focus on the main 
topic of the paper, which is the the regularity of solutions of the HJB equation by means of 
the duality approach. 

(vi) The assumption of strict positivity ofb,a is done to have strict parabolicity of the 
HJB equation. Actually this is needed only in the interior, so we might allow the cases 
b{T) = and/or cr{T) = 0. However, allowing that would bring some other technicalities, 
so we prefer to impose strict positivity also at T. We also stress that we actually need just 
the assumption b{t) 7^ for all t € [0,T]; but, due to continuity, this is equivalent to say 
that b keeps the sign. Since the assumption making sense from a financial point of view is 
b{-) > 0, we impose it. 

(vii) Although for simplicity we consider in our model the case of just one risky asset, 
it is easy to see that the program we described in the introduction works also in more 
dimensions (more risky assets, as in f^). In that case strict positivity of b{t) and cr(t) in 
Assumption \2.1\ should be replaced by the assumption that for all t € [0,T) (the matrix) 
a{t) is invertible and (the vector) b{t) 7^ 0, so that in the dual HJB equation (I25p the term 
\a~'^ {t)b{t)'\^ is then still well-defined and strictly positive. 



E 
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(via) We are concerned with a utility maximization problem. Nevertheless, our ap- 
proach seems applicable also to different cases, e.g. to the case of quadratic risk minimiza- 
tion, by suitably adapting the arguments. 

3 Primal and dual control problem 

Since we are going to apply the dynamic programming techniques, we define the optimiza- 
tion problem for generic initial data (t, x) € [0,T] x M4.. Let t € [0, T] and consider all the 
couples of processes (c, vr) such that 

(hi') c = {cs)s^[t,T\ is a real nonnegative process ^^j-predictable and with trajectories 

locally integrable in [0, T). 

(h2') vr = (7rs)j,g[j -p] is a real process (J-'s)5g[t yj-predictable and with trajectories square 
locally integrable in [0, T). 

Given a; > and a couple (c, tt) satisfying the requirements (hl')-(h2') above, we denote by 
j^t,x,c,-K solution to ([1]) starting at time t from x and under the control (c, vr). We define 
a class of admissible controls A{t., x) depending on the initial (t, x) € [0, T] x [0, +00) as the 
set of couples (c, vr) satisfying the requirement above and such that the corresponding state 
trajectory X*'^''^''^ is nonnegative. We notice that such set is nonempty for each t € [0, T] 
and X > 0, as for such initial data the null strategy (c, vr) = (0, 0) is always admissible. 
Moreover A{t^x) = {(0,0)} if and only if x = 0. Then we define the functional 



We call primal control problem - and denote it by (P) - the optimization problem 



and denote by V the value function associated to this problem - that we call primal value 
function, i.e. 



Due to the fact that the state is an absorbing boundary for the problem and to dSJ-Q, 
we see that V satisfies the boundary condition 




■T 



(P) 



sup J{t,x;c,Tr) 

{c,Tr)eA(t,x) 



V{t,x) 



sup J(t,x;c,7r), (t, x) G [0, T] x M+. 

{c,'rr)eA{t,x) 



V{t,0) 



0, vte[o,r]. 



(6) 



On the other hand V clearly satisfies also the the terminal condition 



y(r,x) 



U2{x). 



(7) 



Set 



Dt := [0,r) X (0,+(X)). 
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By standard arguments of stochastic control (see e.g. [25l Ch. 4]), we can associate to F a 
HJB equation in Dt, which we call primal HJB equation. It is 



-vt{t,x)- sup Hcv{t,x,Vx{t,x),Vxx{t,x);c,ir) = 0, 

c>0, ttGK 

where the function Hcv is defined for (t, x, y, Q) € Dt x M^, c > 0, tt G M, as 



(8) 




When y > and Q < (which is the case we will consider), the Hamiltonian 



H{t,x,y,Q) 



sup Hcv{t,x,y,Q;c,7i:) 



c>0,7rgM 



is finite and takes the form 



H{t,x,y,Q) 



Ul{t,y,x) 



2a^t) Q 



(9) 



where Ul is the sup-Legendre transform of Ui with respect to c, i.e. the function (convex 
in y) 

U^{t,y,x) := sup {Ui{t,c,x) -cy}, (t, y, x) G [0, T) x (0, +oo) x M+. 

c>0 

We expect that V may be characterized as solution of ([8]) completed by the boundary and 
terminal conditions ©-(IT]). We do not tackle directly the above equation ([8]), even if a 
characterization of V as unique viscosity solution to it could be performedl§ We just note 
here that this equation is fully nonlinear and degenerate, so the regularity of its solutions 
cannot be obtained dealing directly with it by the known methods of classical solutions of 
PDE'sl What we can do is to apply duality to the problem and get a dual control problem 
with an associated HJB equation for which we are able to prove regularity results. For this 
purpose, consider, for {t,y) G [0,T) x (0, +00), the sup-Legendre transform of Ul{t,y,-), 
i.e. the function (convex in (y, n)) 



^One could try to prove the continuity of V, then show that V is a viscosity solution of the HJB equation 
and finally use quite standard analytical techniques to prove a comparison in the viscosity sense for the 
equation and therefore get uniqueness for it (see e.g. [6l ll4|[25| ). Otherwise one could try to drop the proof 
of the continuity and deal with discontinuous viscosity solutions, for which the comparison is a bit harder to 
prove (see |14l Ch. VII]), and then prove the continuity a posteriori as a consequence of the characterization 
as viscosity solution. We will not do that, since our study of the dual HJB equation will be sufficient to 
come back and prove a characterization of V as classical solution to the HJB equation within a suitable 
class of smooth functions. Our uniqueness result will be weaker than what can be obtained by the viscosity 
approach, but will be enough for our purposes. 

■^To this regard, we should mention, e.g., [5l[8l[26] for direct results in this direction, when the problem 
is autonomous and over an infinite horizon, and the equation elliptic. Up to our knowledge, despite a sketch 
in [26], there are no results of this kind for parabolic HJB equations coming from investment-consumption 
problems - as the one we deal with in this paper. 




(10) 



sup {Ui{t, c, x) — cy — xu}, {t, y, u) G [0, T) x (0, +00) x (0, +00). 



c,x>0 
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For convenience of the reader, we notice that, when Ui is separable in x and c, i.e. 

Uiit,c,x) = U[^\t,c) + U[^\t,x), we have 

U!{t,y,u) = Ui^'\t,c) + Ui^\t,x), 

where Ui^ \ Ui ^ are, respectively, the sup-Legendre transform of Ui^^\ Ui^"^^ with respect 
to the second variable. Finally, we consider also the sup-Legendre transform of U2, i.e. the 
function 



U2{y) = sup {U2{x) - xy} , y>0. 

x>0 



(11) 



Given (t, y) € Dt, we may consider a new control problem - which we call dual control 
problem and denote by (D) - that we are going to define (for the derivation of the argument 
see [Ml Sec. 1]). Let (3 = {(3s)se[t,T) be a fixed adapted process with locally bounded 
integrable trajectories and consider the controlled process defined by the SDK 



dYs = -Usds + ^sYsdWs, 
Yt = y, 



(12) 



with ti € U(s{t,y), where 



Ul3(t,y) = {ius)s£[t,T] is (-^s)sG[t,T] "Predictable, nonnegative, with integrable trajectories, 

and such that y^*'?^'/''" > a.s. Vs e [t, T]}. (13) 

Let X e M+, y > (c, vr) G A{t,x), u G U,3{t,y), and set X = X*'^'^''^ and Y = y*.^'/^.". 
Integration by parts yields 



d{XsYs) = i-UsX, - CsY,)ds + ys(vr,a(s) + /3,X,)dT^, + Y,7Ts{b{s) + /3sa{s))ds. 



If 



b{s) + f3sa{s) = 0, VsG[t,r], (14) 

it follows that the process {XsYs + J^^u^Xr + CrYr)dr)g^\^t^x] is a supermartingale (as a 
positive local martingale), and in particular 



E 



XtYt + J^ (u^Xs + CsYs)ds 



< xy. 



(15) 



Now, by definition of and U2 and by (fT5]l . if y^ > almost surely for each s G [t,T], 
then 



E 

< E 

< E 



j\l{s,C,,Xs)ds + U2{XT) 



T 



[Ul{s, Ys,Us) + CsYs + UsXs)ds + U2iYT) + XtYt 



(16) 



T 



Ul{s,Ys,Us)ds + U2{YT) 
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Since (c, tt) E A{t, x) is arbitrary, taking the supremum over (c, vr) G A{t, x) on the left 
handside in ([72]) . we get for every u £U{t,y) 



V{t,x) < E 



UI{s,Ys,Us)ds + U2(YT) 



+ xy. 



(17) 



Therefore, when (|14p holds, the right handside of (|17p is an upper bound for the primal 
value function. On the other hand we can take the infimum over u E hlp{t,y) in the right 
handside of (|17p . Taking into account that (|17p has been derived under (|14p . this leads to 
consider the control problem 

(D) inf J(t,y;n), 

u£U{t,y) 

where U{t, y) is the set defined in (fT3]) when /3 is given by ([T 



J{t,y;u) 



E 



UI{sX'''''',Us)ds + U2{Y, 



T ) 



(18) 



and y*'?^'" is the solution to ()12p when (3 is given by ()14p . i.e. the solution to 



= ■ 
Yt = y. 



-Usds - ^YsdWs, 

a{s) 



(19) 



We denote by W the value function associated to this problem - that we call dual value 
function - i.e. 



W{t,y) := inf J{t,y;u) 

u£U{t,y) 



(t,y) G [0,T] X (0,+oo). (20) 
Taking the infimum over u € hl{t, y) in the right handside of (jl7p we get the inequality 



sup {V{t, x) - xy}, {t, y) G [0, T] x (0, +oo) 

x>0 



V{t, x) < W{t, y) + xy, V(t, y) G [0, T] x (0, +oo) 
Defining the Legendre transform of the primal value function 
V{t,y) : 

from ([21]) we get 

V < on [0,r] X (0,+oo). 
What one can expect is the equality 

V = W, on [0,r] X (0,+oo). 



(21) 



(22) 



(23) 



We will prove (j23p as corollary of our next results. 

By standard stochastic control arguments we may associate to W an HJB equation that 
we call dual HJB equation. It is the semilinear equation 



wt{t,y) - !!_if^^ y'^Wyy{t,y) - inf Hcv{t,y,Wy{t,y)) = 0, 



2a2(t)- 



«>o 



(24) 
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where 



Hcv{t,y,q) ■■= U^{t,y,u) -uq, 

with terminal condition W{T, ■) = U2- Since Ui{t,y, •) is concave, the inf-Legendre trans- 
form of C/*(t, y, •) on (—00,0), i.e. 

inf {U* {t, y, ■) -uq}, q < 0, 

u>0 

is equal to Ui{t,y, •). So, where Wy < - it will be the case of our solution - (p4|) can be 
rewritten as 

b'^(t) 

-Wtit,y)-^-^^y^Wyy{t,y)-U*{t,y,-Wy{t,y)) = 0. (25) 

Remark 3.1 Due to the presence of current cost in the state (i.e. the dependence ofUi on 
x), we have a (real) dependence ofU^ onug in the functional (jlSp defining the dual problem. 
Since this dependence is monotone (nonincreasing) and since is also nonincreasing on 
Ys and Us appears with the negative sign in (jl9p . this creates a real trade-off between the 
functional (jlSp and the state equation (|19p. giving rise to a real (nontrivial) control problem. 
At the level of the dual HJB equation ()24p above, this can be appreciated by the presence 
of a nonlinearity in the first order term. When, as in \24^ , the function Ui does not 
depend on the dependence of this term on Wy disappears and the dual HJB equation is 
linear. While in the linearity of the dual equation allows to deal with analytical solutions 
expressed through the heat kernel, a different and more theoretical approach is needed here. 
We are not aware of papers where the dual problem is investigated when also utility on the 
current wealth is considered; nevertheless, we stress that utility on the current wealth arises 
in concrete problems, as the ones described in Sectionl^i 

4 The dual value function as classical solution of the dual 
HJB equation 

In this section we show that is a classical solution to the HJB equation ()25p . To do that 
first we show that it is a viscosity solution to ()25p and then we show its regularity. 

4.1 ly as viscosity solution of the dual HJB equation 

Before to proceed, we need to investigate some properties oi U^, U2 and derive qualitative 
properties for W. 

Proposition 4.1 We have the following properties of the functions U* and U2. 

1. Ul : M+ X (0, +00) X (0, +00) — )■ M zs nonnegative, convex in {y, u) and nonincreasing 
in y and u. 

"'Actually in [2] the function Ui expressing the current utility is not even considered. However, as outlined 
in [2], considering a current utility depending only on consumption would not complicate the mathematical 
problem. 
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2. \Ji : (0, +00) — 7> M zs nonnegative, convex and nonincreasing. 

3. We have the following growth estimate: there exists K > Q such that 

U*{t,y,u) + U2{y) < K{l + y~^ +u-^), t G [0, T), n > 0, y > 0. (26) 

4- We have 

(i) lim Ul{t,y,u) = 0; (n) lim = 0. (27) 

yAu^+OD y—^+oo 

5. According to (a) or (h) of Assumption [KW iv). we have respectively either 

(a) 3e > such that lim Ul{t,y,u) = +00 uniformly in {t,u) € [T — e,T) xM_|_, 

y^0+ 



or 



(6) lim U2{y) = +00, 

y^0+ 



or both 

y5/2,k+S 



6. Ul G C°l^r {\^,T) X (0,+oo) X (0,+oo);M). 

Proof. 1-2-3 follow straightly by using the properties of Legendre transforms and Assump- 
tion I2.2r i. ii, iii). 

4. For fixed t > 0, let for y > 0, n > 0, 

Ku = |(x,c)G]R^ I ■^Ui{t,x,c) > y, ^Ui{t,x,c) > n| U {(0,0)}. 

Using Assumption I2.2r i) , it is not difficult to see that the maximizer in the definition of 
U^{t,y,u) belongs to Ay^u and that Ay^u shrinks to {(0,0)} as y ^ +00 and u +00; so 

lim sup Ui{t,y,u) < lim sup sup Ui{t,x,c) = f/i(t,0, 0) = 0. 

yAu^+00 yAu^+00 (a;,c)eAy,u 

The limit for U2 follows with a similar argument. 

5. If we are in the case of Assumption 12 . 2f iv) (a) . then, due to monotonicity with respect 
to u of U^, the statement (a) is equivalent to 

3e > such that lim lim UHt,y ,u) = +00, uniformly w.r.t. t € [T - e, T). (28) 

J/— >0 u— >+oo 

Now, by dH), using the same argument of point 4 above, but with respect to u only, we get 

lim U:{t,y,u) = sup {C/i(t, c, 0) - cy}, uniformly w.r.t. i G [T - e, T). (29) 
w-)-+oo ^>o 

Since taking c = 1/y we get 

svip{Ui{t,c,0)-cy} > C/i(t,l/y,0)-l, (30) 

c>0 

the claim (j28p follows combining (I29p -( i30]l and using Assumption 12. 2( iv) (a). 
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In the case of Assumption I2.2n v) (b) the claim (b) can be obtained as above (but more 
easily) by using the definition (jlip . 

6. If Assumption I2.2r i) (b) holds, the claim is immediate as 

Ul = Ui e <f'=+^([0,r) X (0,+oo) X (0,+oo);M). 

Let us prove the claim in the case when Assumption (|2.2|) (i)(a) holds true. Under our 
assumptions, the map c -^Ui{t,-,x) is a bijection from (0, +00) to (0, +00) for each 
{t,x) £ [0,T) X (0,+cx)), and the supremum in the definition of U* is attained at the 
unique c*{t,y,x) satisfying 

^^Ui{t,c*{t,x,y),x) = y. (31) 

Since -^Ui < 0, it follows from the implicit function theorem that c* has the same regularity 
properties as ^Ui, i.e. it is cf^^'''~^^\[0,T) x (0,+oo) x (0,+(X));M). Writing 

Ui{t,y,x) = Ui{t,c*{t,y,x),x) - c*{t,y,x)y 

and using (fSTI) . we obtain 

d 

— Ul{t,y,x) = c*{t,y,x), 

d ^ d ^ 

Q^Ui{t,y,x) = -^Ui{t,c*{t,y,x),x). 

Both of these functions lie in C^^^'^ ^^^{[0,T) x (0, +cx)) x (0, +cx));M), which proves the 
claim. □ 

Proposition 4.2 W is finite, strictly positive on Dt, convex and strictly decreasing in y. 
Moreover, we have the growth condition, for some Kw > 0, 

W{t,y) < Kw{l + y~^), V(t,y) G [0,T] X (0,+CX)), (32) 

and terminal and boundary conditions 

'(i) WiT,y) = U2{y), VyG (0,+oo); 

(n) lim,y^o+ W{t,y) = +00, VtG[0,r); (33) 
(m) limy^+00 W{t,y) = 0, VtG[0,r]. 

Sketch of proof. The arguments are quite standard and we only sketch the proof of 
the claims which are straightforward. 

Taking the feedback control Ug = Yg in the state equation ()19p and using ()26p . we obtain 
that W is finite and satisfies the growth condition ()32p . The strict positivity in Dt is more 
tricky and we give a complete proof, which follows from Proposition 14.1( 5). Indeed, let 
{t,y) G Dt. Since y^'^'" < for each u G U{t,y), we get 



J{t,y;u) > E 



£ Ulis, Y,'^y^^, us)ds + C/2(y^'^'°) 



yu£U{t,y). (34) 
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Since Y^'^'^ is a Geometric Brownian Motion, setting 

41 ■■= { sup n*'^'°<yo|, 

sG[tV(T-e),T] J 



we have 



^Al^yj > 0, Ve > 0, Vyo > 0. 



Now, set for all (s, yo) e [0, T) x (0, +oo) 



5(5,^0) := lim U;;;{s,yo,u). 

«— >+oo 



Using dM]), (I35|) and (IMl), we get 



J{t,y;u) > v% 



yo 



tV{T-e) 



g{s,yo)ds + U2{yo) 



(35) 



(36) 



(37) 



Now, if Assumption I2.2r iv)(a) holds, take e above as the one in appearing in the same 
assumption. By Proposition 14. 1( 5) (a), we can choose yo > such that g{s,yo) > 5 for all 
s € [t, T] for a suitable 5 > 0. Since ()37p is uniform in u € U{t, y), we get the claim in this 
case. If we assume that Assumption I2.2( iv)(b) holds, then from it, (j37p and Proposition 
I4.ir 5)(b) still follows the claim. 

Convexity comes from convexity of C/j* and U2, and from linearity of the state equation 
by standards arguments. Also monotonicity is consequence of standard arguments due to 
monotonicity of and f/2. 

The terminal condition (j33p (i) comes from the definition of W immediately. 

The boundary condition (|33|) (ii) can be obtained arguing as in the proof of strict posi- 
tivity of W. Indeed, we can consider (I37p with yo = U- Then, since Y^'"^'^ = yY^'^'^ we get 
that 



pI% = > 0, VyG(0,l) 



Therefore, (|37p becomes in this case 

f-T 



J{t,y;u) > 
from which we get 



tV(T-e) 



g{s,y)ds + C/2(y) 



Vti G U{t,y). 



W{t,y) > 



g{s,y)ds + U2{y) 



ty{T~e) 



(38) 



(39) 



(40) 



Taking the limit for y ^ 0"^ and using Proposition 14.1( 5). we get (133p (ii). 

Let us show now the boundary condition (l33]l (iii). Let (t,y) € [0,T] x (0, +00) and take 
the feedback control Ug = Ys in ()19p and consider the associated state trajectory Yg'^'^. 
Then 



r rT 



W{t,y) < Jit,y;u) 



E 



T I 



(41) 
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Since 



^ s 



2^2(0 ' 



<0 



y ■ exp 

we have 

Yt,V,u _^ ^ 

Hence, using ([?7|) and we get 

cJ;*(s,y/'S''",y,*'2''") ^ 0, Vs G [i,r], a.s., and [^(y^ 
On the other hand, thanks to ()26p . we have 

c7*(s,y/'^'",yi'^'") < (i + 2(y/'^'")-T^) , c}2(y^'^'") < + (y^'^'")"^; 



rt,y,u\ 



0, a.s. 



(42) 



(43) 



Since the above right hand sides are integrable uniformly in y > 1, using (|41|) and (j43p we 
get the claim by Vitali's Theorem. 

Finally, strict monotonicity follows from convexity, monotonicity, strict positivity and 
(1331) (iii). □ 



Proposition 4.3 W is continuous on [0, T] x (0, +cxd). Moreover W{-,y) is is nondecreas- 
ing for all y € (0, +oo). 

Proof. First of all, by convexity, W is continuous in the space variable y for each fixed 

te[o,T]. 

Let us show continuity in time. For that, we need to exploit the following Dynamic 
Programming Principlel§ for each t,t' such that < t < t' <T and each y G (0, +oo). 



Wit,y) 



inf E 

ueU{t,y) 



u^{s, Y,''y'^,us)ds + w{t', y,*'^'") 



(44) 



Now we show that W is nonincreasing in time. Indeed, let {t,y) G [0,T) x (0, +00), let 
u G U{t, y) and let t' G [t, T]. Since f/J* > 0, from (03]) we have 



W{t,y) > inf E l^(t',y^**") 

ueU(t,y) I 

By monotonicity of in y and since Yp^'^ < Y^^'^ for all u G U{t,y), we get 



inf E 

ueU{t,y) 



> E 



W{t\Y* 



VF(i',yj*'^'") 

Combining pSj) and and using Jensen's inequality, we finally get 

W{t,y) > W{t',y), 



(45) 



(46) 



''Appealing to the Dynamic Programming Principle may seem somehow unfair, as usually it is problematic 
to prove it if one has not proved before the continuity of the value function (and we are just proving the 
continuity invoking it). However, we observe that in this case (where the time t' is deterministic) the proof 
of the Dynamic Programming Principle (see, e.g., [251 Ch. 4]), only uses the continuity in the space variable 

y- 
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proving the monotonicity claim. 

From this monotonicity it follows that the functions provided by the left and right limits 
of W in t, i.e. 



lim W(t + h, 



W.{t,-) := lmiW{t-h,-), 



are well-defined in [0, T) and (0, T] respectively, and 

W- > W > W+ 



(47) 



(where the functions are defined). We note that W^,W- are also convex in y for fixed t, 
so they are continuous in y for fixed t as well. If we show the inequalities 



W_ < W < W. 



(48) 



(where the functions are defined) combining with (j47p the proof of continuity in time will 
be complete. 

Let us first show the left inequality in ()48p . For any s G [0, T], define Y^'^ as the process 
corresponding to the feedback control u. =Y. starting from {s,y). Then, for each r > s, 



r 



yexp 



-1 + 



1 KO' 



^(0 



Note that, since is bounded, we have the following estimates : 



E 



y/'^ — y < uj{\s — r\), with uj continuous and (^{O'^) = 0, 



sup E 

0<r<s<T 



< +00, \/q € 



(49) 
(50) 



Let t £ [0, T] and take a sequence t„ t By (glD and ([26 
Witn,y) < E 
< E 



/ u^is, y,*"'^, Y^^"'y)ds + w{t, y/"'^) 



2K{i + (y/"'J')"T^)(is + w{t, y/"'^) 



(51) 



By (j50p the expectation of the integral in (j5ip goes to 0. On the other hand, from (j49p . 
passing to a subsequence if necessary (we have monotonicity in t, so we can do that without 
loss of generality), we see that y^*"'^ y almost surely. Hence, using (l50|l and the growth 
condition (f32]l on VF, by dominated convergence we get 



lim E 

n— >oo 



VF(t,y/"'^) 



W{t,y). 



So, we finally obtain W^{t,y) < W{t,y). 

Now let us turn to the proof of the right inequality in ()48p . Let t € [0,T) and take a 
sequence tn J, t. Again, using we have that 



W(t,y) < E 



c/f(s,y/'^yi'^)ds + H^(^„,y, 
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The proof is now the same once we show that W{tn,Y^J^^) — )• ahnost surely. We 

observe that W{tn,-) \ W+itr) pointwise by definition. Since all these functions are 
continuous, by Dini's Theorem we get •) \ •) locally uniformly. Therefore 

tn i t, Un ^ y implies W{tn,yn) W^{t,y). Since, by passing to a subsequence if 
necessary (again we may do that without loss of generality because of monotonicity in t) 
we can assume y/^'^ — )■ y almost surely, it follows that W{tn, Yt^) Wj^{t, y) almost surely. 
And again by dominated convergence this implies W{t,y) < VF+(t, y). This completes the 
proof of continuity in time. 

Now it just remains to notice that again by Dini's Theorem the continuity W in t 
is locally uniform in y, which combined to the fact that W is continuous in y for fixed t, 
implies joint continuity of W in {t,y). □ 

Now we may state the viscosity property of W. 

Proposition 4.4 W is a continuous viscosity solution to (|25p in Dt- 

Proof. Due to continuity of W ^ this is quite standard. We omit the proof for brevity 
and refer to classical references, such as [141 125j. □ 

4.2 Regularity of W 

In this section we prove a regularity result for the dual value function W . 
Theorem 4.5 

1. W<^c]^f"'^^^^\DT;^). 

2. Wy{t, •) < 0, Wy{t, 0+) = -oo and Wy{t, +oo) = 0, for every t > 0. 

3. Wyy > over Dt- 

Proof. 1. Take any (toiyo) € Dt and consider, for suitable e > 0, the square 
De{to,yo) ■■= [to,to + e) X {yo-e,yo + e) C Dt- 

First of all, note that, due to convexity, the right and left space derivatives of W ex- 
ist. Denoting them by Wy{t,y^) and Wy{t,y~) respectively, again by convexity we have 
Wy{t,y~^) > Wy{t,y~). Moreover, there exist M^, > such that 

M, > sup -Wy{t,y') > inf -Wy{t,y+) > m,. (52) 
(t,y)£De{to,yo) {t,y)&De{to,yo) 

Indeed, by convexity —Wy{t,y^) > ^{W{t,y) — W{t,2y)), and, since W is continuous and 
strictly decreasing in y for each t, the infimum above must be strictly positive. In the same 
way, —Wy{t,y~) < ^{W{t,y) — W{t,y/2)) and the supremum is finite. 

By Proposition 14.41 the dual value function is a viscosity solution of the dual HJB 
equation (f25]l in Ds{to,yQ) with Dirichlet boundary condition 

w = W, on V{Deito,yo)), (53) 
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where V{Df,{tQ,yQ)) is the paraboUc boundary of De(to,yo) defined as 

'P{De{to,yo)) := {to + e} x [yo -e,yo + e]U [to, to + e] x {yo -e,yo + e}. 

Consider the function F defined on L'£(to,yo) x R by 

F{t,y,q) := C/i* (t, y, -[(m, V (/) A M^]) . 

By Proposition 14. 1( 6). F is Holder continuous in D^{to,yo) x M. By ([52]) . we have that W 
is actually a viscosity solution in L>£(to,yo) to the equation 

- wt{t, y) - 2(j2{i^ y^Wyy{t, y) - F{t, y, Wy{t, y)) = 0. (54) 

Since W is continuous on V{Di,{tQ^yQ)), then we have uniqueness of viscosity solutions to 
(i54l) with boundary condition ((53]) (see, e.g., [Ml Cor. 8, Ch. V]). On the other hand, due 
to Assumption 12.11 and to Holder continuity of F, the PDE ([54]) is semilinear uniformly 
parabolic on D^{tQ,yQ) with Holder continuous coefficients, so by Theorem 12.22 of |22j - 
with the assumptions of Theorem 12.16 of the same book - it admits a solution fulfilling 
the boundary condition ([53]) in the space C^''^{D!r{to,yo);'R.). This (classical) solution is 
also a viscosity solution, thus, due to uniqueness of viscosity solutions, it coincides with 
W. Hence, we conclude that W € C^''^{D^{to,yo);W), therefore, by arbitrariness of ito,yo), 
that W G C^''^{Dt;R). 

Given that, we know that —Wy is strictly positive and locally Lipschitz continuous 
in Dt. Moreover, by Proposition ST^G), G cf/^^'^'^^dO, T) x (0, +00) x (0,+oo);M). 
Therefore, the claim follows from a simple induction, using regularity results for linear 
equations of the form —ut — Lu = f (see, e.g.. Theorem 8.12.1, p. 131, in [21]). 

2. The first claim follows (I52p . The other ones follow from convexity and from (I33p (ii) 
and ([33]) (iii). respectively. 

3. As in [2] we use a maximum principle argument. Differentiating twice (|25p . we get 



iUl)yy{t,y, -Wy) + Wyyy ■ ([/^.(t,^, -Wy) 



^^yy^' " 2^ [^^^^ + ^yiWyy)y + y\Wyy)yy 



+ 2Wyy ■ iU^).y{t,y,-Wy) -Wy'y ■ {Ul)..{t,y,-Wy) = 0. 

Noting that Uf is convex in y, we see that Wyy is a nonnegative supersolution to the linear 
parabolic PDE 

b'^(s) 

-Ut - 2cr2(^s) ~^ ^^"^ ~^ y'^^yy] + i^Dxit, V, -Wy)uy 

+ [2{U^)xy{t, y, -Wy) - Wyy ■ {U^)^^{t, y, -Wy)]u = 0. 

Hence, by a strong maximum principle (see e.g. [Ml Th. 3, Ch. II]), if Wyy{to,yo) = for 
some (to, yo) ^ Dj-, it must be Wyy = on {tQ,T) x (0, +oo), which is clearly in contradic- 
tion, e.g., with ([33]) (ii) . □ 

From Proposition 14.41 and Theorem 14.51 we get the following 
Corollary 4.6 W is a classical solution to (|25p in Dt- 
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5 Back to the primal control problem: verification and op- 
timal controls 



Let t G [0,T] and let W be the inf-Legendre transform of W{t, •), i.e. 

W{t,x) := mf{W{t,y)+xy}, {t,x) dD^. (55) 

Due to its definition and to the positivity of W (see Proposition 14. 2p . the function W is 
finite and nonnegative on Dt- Moreover, it is concave and nondecreasing in x for each 
t G [0, r] and, due to Theorem 14. 5| it can be written, for (t,x) G Dt, as 

W{t,x) = W{t,[Wyit,-)rH-^))+^[Wy{t,-)]-\-x). (56) 

We are going to prove that 

W = V, onD^ (57) 

(we notice that (f57j) implies, as corollary, (|23|) . i.e. V = W) and that V is the unique 
classical solution of the primal HJB equation ([8]) in the following class: 

C = ^ve C(D^; R) n C/J:^/^'^'+^+'^(L't; R) such that > 0, v^^ < in Dt, 

and V fulfills the boundary and growth conditions ([58]) belowj 

where 

(z) v{t,o) = 0, vt G [o,r], 

[ii) v{T,x) = U2{x), yx>0, (58) 
(m) 3i<:o such that < v{t,x) < Ko{1 + xP), V(i, x) G [0, T] x [0, +oo). 



We note that if f G C, due to ([9]), we have 

b'^(t) V (t x)^ 

H{t,x,v,{t,x),v,,{t,x)) = UUt,v,it,x),x) - I \ . (59) 

2a\t) Vxx[t,x) 

We proceed as follows: 



1. We show that W C and that it is a classical solution of the primal HJB equation 
dSD (Proposition EH). 

2. We show that a verification theorem holds for (P) for every classical solution u G C 
of the primal HJB equation (Theorem 15. 2p . 

3. We show that for every classical solution t; G C of the primal HJB equation the associ- 
ated closed loop equation admits a solution and that this implies v = V (Proposition 
[Q and Corollary [531) • 



Clearly, these three points yield the equality W = V and the announced uniqueness. 
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5.1 W is a classical solution of the primal HJB equation 

Proposition 5.1 W (z C and solves the primal HJB equation ([8]) in classical sense in Dt- 
Moreover it satisfies the Inada conditions in x: 

vi?^(t,o+) = +00, w^{t, +oo) = 0, vte[o,r). 

Proof. Growth and boundary conditons. The growth condition (I58p (iii) follows from ()55p 
and ()32p . The boundary condition ()58p (i) follows from (j55p and ()33p (iii). The boundary 
condition (jSSp fii) follows from (j55p . (jSSp fi) and the fact that the inf-Legendre transform of 
U2 is U2. _ 

Continuity in Dt- The fact that W is continuous in Dt follows from (j56p and Theorem 
14.51 Now we show the continuity at the boundary [0, T) x M. 

Continuity of W{t, •) at 0"^ for each t G [0,T) follows from (|55]) : it yields 

W{t,x) < W{t,e/x)+e, Vx > 0, Ve > 0, 
hence, taking into account also that W is nonnegative and (|33p (iii). 

< limsupT^^(t,x) < e, Ve > 0, 

and, since e is arbitrary and taking into account ()58p (i). we may conclude that 

l[mW{t,x) = = W{t,0). 

Moreover, by monotonicity of W{t, •) for all t G [0, T) the convergence above is locally 
uniform in t G [0, T) due to Dini's Theorem, so, combining with the obvious continuity of 
W{-,0), we get the continuity of W at the boundary [0,T) x M in the couple {t,x). 

Next we show the continuity at the boundary {T} x M. First let us show the continuity 
of W{-,x) at T~ for fixed x G M. Since W{t, 0) = for every t G [0, T], the claim is obvious 
for X = 0, so we now assume x > 0. Clearly, for any y > 0, 

limsup W{t,x) < lim sup {W{t,y) + xy} = W{T,y) + xy, 

by continuity of W. Taking the infimum over y, we obtain the inequality 

limsup W{t,x) < W{T,x). 

For the opposite inequality, we notice that, by definition of VF, we have for each y > and 
each te[0,T] 



where we have used Jensen's inequality. Since W{T, •) = U2{-)-, we get W{t, •) > W{T, 
which in turn yields 

liminf W{t,x) > W{T,x). 



rt,y,0 
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Now, taking into account the obvious continuity of W{T, •) in M4., the continuity of W at 
the boundary {T} x in the couple {t,x) follows again from Dini's Theorem, as W{-,x) 
inherits from W{-,y) the monotonicity (Proposition I4.3| ) . This concludes the proof of the 
continuity of W on D^- 

Further regularity in Dt- From (I56p and taking into account Theorem 14. 5| we get for 
each (t, y) G Dt 

'{i) Wt{t,x) = Wt{t,[Wy{t,-)]-H-x)), 

< (ii) W,{t,x) = [Wy{t,-)]-H-x), (60) 

1 



(Hi) Wocx{t,x) 



'Wyy{t,[Wy{t,-)]~H-X))' 



So, due to Theorem [131 we have W G cI^^^^'''^'^^\Dt;R) and > 0, VF^^ < in Dt- 
This completes the proof that W £ C. 

W as solution to the HJB equation. The fact that W solves the HJB equation ([8]) in 
classical sense in Dt follows from Corollarv l4.6l bv straightforward computations using (j59p 
and (|60l) . 

Inada's conditions. Inada's conditions follow from Theorem [53^2) and (j60p (ii). □ 
5.2 Verification theorem 

Theorem 5.2 Let v £ C be a classical solution to the primal HJB equation ([8|). Then: 
(i) v{t,x) > V{t,x) for all {t,x) G D^. 

(ii) Let {t,x) G D^, let {c*,7r*) G A{t,x) and let X* := X*'^'^*'^*. If 

H,,{s,x:,vx{s,x:),vxx{s,x:y, c:,^) = h{s,x:,vx{s,x:),vxx{s,x:)) (ei) 

¥-almost surely for almost every s G [i,?"], then (c*,7r*) is an optimal control and 
v{t,x) = V{t,x). 

Proof, (i) Let {t,x) G Dt, (c, tt) G A{t,x), and, to simplify the notation, let us write 
Xs := X*''^'''^ for ah s G [t,T]. Set 

T := inf {s G [t,T] | = 0} A T. 

We notice that, due to the state constraint, A{s,0) = {(0,0)} for all s G [t,T] and the 
corresponding state trajectory is identically 0, so 

if T<T, then(c, 7r,X) = (0,0,0) in the random time interval [r, T] . (62) 

Now we may find a sequence of stopping times Tn t such that Vx{-,X.) is a martingale in 
[t,Tn]. Since v G C^'^([t,T) x (0, +oo);IR) and satisfies the HJB equation ([8]), Ito's formula 



21 



yields 

E[v{Tn,XrJ] = V{t,x) + E 

- E 
< vit,x)-E 

This gives us 



{Hcv - H){s,Xs,v^{s,Xs),Vxx{s,Xs);Cs,7rs)ds 

Tn 

Ui{s,Cs,Xs))ds 
Ui{s,Cs,Xs)ds 



v{t,x) > E 



v{Tn,XrJ+ / Ul{s,Cs,Xs)ds 



Vn G N. 



(63) 



Letting n — >■ oo in (j63p . using Fatou's Lemma on the first term of the expectation of the 
right handside, and monotone convergence on the second one, we get 



v{t,x) > E 
= E 
+ E 



v{T,Xr) + J Ul{s,Cs,Xs)ds 
'^{T<T}{y{T,Xr) + Ul{s,Cs,Xs)ds 
l{r=T}{v{T,Xr) + Ul{s, Cs, Xs)ds 



(64) 



Using ([62]), the fact that C/2(0) = and that Ui{-, 0, 0) = v{-, 0) = 0, we get 



v{t,x) > E 



U2{Xt) + j\i{s,Cs,Xs)ds 



(65) 



Since (c, vr) G A{t^y) was arbitrary, this means that v{t,x) > V{t,x), and (i) is proved. 

(ii) Let (c*,7r*) G A{t,y) satisfy ([61]), and denote X* = X*'?''^*'''*. In this case we have 
equahty in ([63]) . i.e. 



v{t, x) 



E 



v{Tn,x*j+ u,{s,c:,x:)ds 



Vn G N. 



(66) 



Now we take the hmit for n — > oo keeping the equahty above. We cannot use Fatou's 
Lemma as before for the part v{Tn, Xr„), but we need to use a result keeping the equality 
in the limit. Since linin^oo v{Tn, X*^) = v{t,X*) almost surely, it suffices to prove uniform 
integrability of {v{Tn, X*^))n>o- For this purpose, write Ys := Ys'^'^ for all s G [t,T]. We 
know from the discussion following (fT^ that (^X*Ys + clYudu^ ^^^^ is a supermartingale. 
Since c^Ys > 0, we see that also (X*y<j)>,g[o,T] is a supermartingale, hence E[X*^yT-„] < x. 
Now, taking q G (p, 1), we get, using ([58]) (iii) , 



E 



Krn,x*y/p 



< E 



K'^^''{i + \x*jpy/p < k^/^2p~^(i + e[1x;j«]). 



Now, using Holder's inequality, from the inequality above we get 

K v{Tn,x:yp] < jfo(i + E[x;^y.j^E[(y,j-T^]i-«) < k^{i + x^) 
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So the sequence v{Tn, X*^)n>o is bounded in L'?/^ with q/p > 1. By de La Vallee Poussin's 
Theorem it is uniformly integrable. Hence taking the hmit in (j66p we get 



v{t, x) 



E 



v{t,x:)+ / ui{s,ct,x:)ds 



(67) 



Sphtting on the sets {r < T} and {r = T} as above, taking into account that v{T, •) = U2{-) 
for the part corresponding to set {r = T}, taking into account and that f(-,0) = = 
C/i(-,0,0) on the set {r < T}, we finally rewrite ([67|) as 



^'(^,?/) = Jii,y;c*,TT*). 
Combining (|68p with the claim (i) we get the claim (ii). 



(68) 
□ 



From Proposition 15.11 and Theorem 15.21 we see that > V@ What we want to get is 
indeed the equality, and in order to get it we need to exploit further item (ii) of Theorem 
finding optimal feedback controls. 



5.3 Optimal feedback controls 

Given v S C, we may define feedback maps in classical sense associated to the maximization 
of Hcv in the HJB equation ([5]). They are, for s S [0,T), 



C''is,x) 



' ([9.Ul{t,;x)] \v,it,x)), ifx>0, 

lo, ifx = 0, 



0, 



if Assumption 12. 2r i)(b) holds, 



if Assumption 12. 2n ) (a) holds, 



(69) 



Wis^x) 



b{s)vx{s,z) 



.0, 



if X > 0, 

if X = 0. 



(70) 



Their definition for x > is indeed given by the maximization of Hd, in the HJB equation 
taking into account the structure of the Hamiltonian ([9]) for functions in C, while the defi- 
nition at X = is due to the the state constraint, which implies A{t,0) = {(0,0)}. 



The closed loop equation associated to the feedback maps C",!!"" is 

(dXs = -C''{s,Xs)ds + b{s)W{s,Xs)ds + a{s)W{s,Xs)dWs 
\Xt = x. 



(71) 



Since v C, one has local Lipschitz continuity of Il^{s, •) on (0, +oo) for every s € [t,T). 
and local Lipschitz continuity of C'"{s, •) on (0, +oo) for every s G [t,T). So we can prove 
the following. 



®This inequality may be also proved using (|22p and the concavity of in a; which could be proved 
directly. 
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Proposition 5.3 Given v G C and {t,x) G [0, T) x ]R_|_, there exists a unique solution 
X^'^'^' > to the closed loop equation (|7ip in the interval [t, T] . 

Proof. Existence. If x = the claim is clear, just by taking X^'^''"" = 0. Let x > 0. Due to 

local Lipschitz continuity of C^{s,-),W'{s,-), using standard SDE's theory (see, e.g., [201 

Ch. 5,Th. 2.9 ]), we get for each e > the existence of a unique solution X*'^'^''"" G 

in the stochastic interval \t,Te), where is implicitly defined in terms of the solution itself 

as 

Te = inf {s G [t, T] I X*'^'^''' < e or X*'^'"''' > e'^}, 
with the convention inf = T. Of course, if e < e', we have > r^/ and 

^t,x,e _ j^^^^,)^ VO<e<e'. (72) 

Set 

r = limTg. 

£4,0 

Then by (|72|) there exists a unique solution X*'^'^ > to (j71|) in the interval [t,T). We 
now show that this solution can be extended to the whole interval [i,T]. By a Girsanov 
transformation, there exists a probability Q equivalent to P, and a Q-Brownian motion W , 
such that ()7ip may be rewritten as 

dXs = -C''{s,Xs)ds + a{s)U''{s,Xs)dWs. 

By nonnegativity of and X*'^'^, the process X*'^'" is a nonnegative Q-supermartingale on 
[t, r). It can be extended to a Q-supermartingale (L^ bounded) on [t, T] setting X*'^'" = 
in [r, T]. Hence, by Doob's convergence Theorem (the usual proof for deterministic intervals 
- see e.g. Theorem 6.18 in |18j - can be easily adapted to our stochastic interval [t, t)), 
there exists a finite random variable Xr^'^ such that 

limX*'^'" = Q-a.s.. (73) 

s yr 

Since Q ~ P, we also have 

limX*'^''' = X*'^'^ P-a.s.. (74) 

Immediately ()74p yields the desired extension on {r = T}. Let us now consider the set 
{r < T}. On this set we have X*^^'" G {e, e"'^}, so that by ([7¥|) necessarily X*'^'" = 
almost surely, getting 



lim X*'^-'' = a.s. on {r < T}. (75) 



s /V 

Therefore, we may now extend X^'^''" to a solution defined over [t, T] on {r < T} by setting 

X*'^'^' = 0, for s G [T,r]. 

Uniqueness. The solution is clearly unique on the stochastic interval [t, r) defined 
in the existence part. If it reaches 0, it must stay there, since it is a nonnegative Q- 
supermartingale. Therefore we have uniqueness in [t,T]. □ 

By Propositions 15.11 and 15. 3|, and by Theorem 15.21 we get the following. 
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Corollary 5.4 W = V and it is the unique solution in C to the HJB equation ([8]). More- 
over, given {t,x) £ [0, T] x an optimal control in feedback form for (P) starting at 
{t, x) is given by 

c* = TT* = n^(s,X*'^'^), (76) 

where C^,n^ are the feedback maps defined in ([69|) - ([70|) associated to V £ C, and where 
j^t,x;V y^jiiqy^Q solution to (|7ip associated to C^,n^. 

Remark 5.5 As consequence of Proposition [3T7] and Corollary \5.4\ we see that V satisfies 
the Inada condition -^V{t,0^) = +00 even i/^(-,0+), ^(-,0+) and C/2(0+) (which 
are well defined by concavity) are all finite. Indeed, the fact that V satisfies the Inada 
condition at 0"*" is simply due to the fact that x = is an absorbing boundary combined with 
Assumption \2.i^ iv) . 



6 Applications 

Current utility on the wealth may arise in several situations. For instance, we mention 
pension funds allocation (see, in a context of utility maximization, [U [TT] and, in a context 
of quadratic cost minimization, [9l[T6]); optimal portfolio problems with random horizon 
(see [HH]); markets with illiquidity (see [121113]). We are going to describe the latter two 
applications. 



6.1 Portfolio optimization with random horizon 



A first application of our framework is to portfolio problems with random horizon. Consider 
the consumption /investment problem with state equation ([T|) when the time horizon of the 
agent is T A r where T > is fixed and r is some random variable r E [0, +00), i.e. the 
objective to maximize is a functional such as 

rAT 



E 



Gl{t,Ct)dt + G2{T AT^Xr^T) 



(77) 



In this context it is meaningful to assume, in general, that Ft 7^ -7^, and that r is just 
J^-measurable. A special case, which is the one we illustrate, as it may be covered by our 
framework, is when r is independent of J-t (this problem has been already treated in [1] 
in the case of terminal utility). Since r is independent of {J-t)t>o, setting F(t) = P{t < t| 
and assuming that F admits density / over [0, T), the functional (I77p may be rewritten aql| 

rT 



E 



(78) 



/ {Gi{t, ct){l - F{t)) + G2{t, Xt)f{t))dt + (1 - F{T))G2{T, Xt) 
Jo 

So, it falls into our setting - under suitable assumptions on the functions Gi,G2 - with 
Ui{t,c,x) = Gi{t,c){l-F{t)) + G2{t,x)f{t), 



U2{x) 



[l-F{T))G2{T,x). 



^See [T^ for the rewriting of the term corresponding to G2 in the general case when t may be dependent 
on Ft, in which case one has to consider F{t) := P{r < t | Tt}- 
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Therefore we can apply our results, which allow to construct optimal feedback controls by 
Corollary 15.41 To this regard we notice that in [1] the regularity of the value function is 
assumed in the verification theorem, so the results given through the Dynamic Programming 
approach in [1] are definitively based on the possibility of finding (regular) explicit solutions 
to the HJB equation. Hence, while in pQ it is needed to take specific structures for the 
utility function, here we do not need that. 

Finally, we observe that the rewriting of (j77p as (j78p can be performed also in the case 
T = oo. So, applying our Remark I2.3f iv). we get that our results on the HJB equation 
and on the optimal feedback controls hold also in this case. The next subsection provides 
a significant example. 

6.2 Market with liquid and illiquid assets 

A related application of our results is the mixed liquid/illiquid investment model studied 
in \12\ [T3] . We refer to the latter references for details on the model. 

Consider a market constituted by a riskless asset (assumed constant), and two risky 
assets L and / following Black-Scholes dynamics: 

dLt = Lt{bLdt + aLdWt), Lq = 1, 
dIt = It (bidt + ai {pdWt + Vl - p^dBt)'^ , /o = 1, 

where W and B are independent Brownian motions, and p G ( — 1,1) is a correlation pa- 
rameter. 

The specificity of the model is that, while the liquid asset L may be observed and traded 
continuously, the illiquid asset I may only be traded and observed at discrete random times 
(Tfc)fc>o, where we assume that tq = 0, and the interarrival times r^+i — are i.i.d., and 
independent from {B,W). 

The investor's strategy is then a triple {{ct)t>o, i'^t)t>o, (afc)fcGN) where the components 
represent, respectively, the consumption, the amount invested in the liquid asset L at time 
t, and the amount invested in the illiquid asset / at time r^. The investor's wealth then 
follows the dynamics 

Ro = r, 

Rt = ^Tk+ J {TTsibids + aLdWs) - Cgds) + ~ "^j ' * ^ Tk+i]- 

The investor aims at optimizing the following criterion 

POO 

V{r) = sup E / e-^'U{cs)ds, 

{ct,iTt,ak)eA{r) Jo 

where C/ is a utility function, the discount factor /3 > is chosen large enough to guarantee 
finiteness to the problem, and the set A{r) is the set of admissible controls keeping the 
wealth nonnegative. 
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Let ao S [0,?"] and define, in tlie random interval [0,ri), the processes X,Y, J as 



dXt = 
dYt 



-ctdt + TTtibhdt + aidWt 

'phlCTl 



dt + paidWt^ , Yo 
It 



r - ao, 



Jt 



Yt 



In other words, Xt is the liquid wealth at time t (the wealth held in the riskless or in 
the liquid asset), YtJt is the wealth held in the illiquid asset I, and the total wealth is 
Rt = Xt + YtJt. 

We may apply a Dynamic Programming Principle between and ti, and see that V 
satisfies the following dynamic programming principle: 



V{r) = sup sup E 

0<oio<r {ct,Ttt)&A'{r,ao) 



e~'^'U{cs)ds + e-''^W{R 



(79) 



where ^'(r, ao) is the set of admissible controls {ct,7rt) keeping the process X nonnegative 
in the interval [0,ri). Let us focus on the inner optimization problem in (j79p . i.e. assume 
that ao is fixed and we want to optimize only on {ct,TTt) £ -^'{fjCtQ), and let us show how 
this problem may be rewritten so as to fall in the framework of Subsection 16.11 

Let = {T^)t>o denote the filtration generated by W. We note that Y is F^- 
adapted, while J is independent of F^. Moreover, since I is not observed in the interval 
[0, Ti), the information available to the investor is given by the filtration F^ in that interval. 
Hence, defining the function {t,x,y) i-7> G[V]{t,x,y) := E,[V{x + yJt)] and taking the 
conditional expectation with respect to J-^ in the inner optimization problem of ()79p . this 
last one may be rewritten as 



sup E 



Tl 



e-^'U{cs)ds + e-^^'G[V]{Ti,Xr„Y, 



(80) 



Now, if we choose U{c) = ^, p G (0,1), the value function V will be p- homogeneous, 
V{r) = Kv^, and we can reduce the state space of the above inner control problem to one 
space dimension. Indeed, let us consider the state variable Zt := Letting 



Y 



one may check that Z is solution of the SDE 

dZt = -Ctdt + Ot {{hL - p(Ti(TL)dt + aLdWt) 
Furthermore, (j80|) may be rewritten as 



Zn 



ao 



sup E 

{ct,et)(^A"{z) 



e-P'Y!U{cs)ds + e-^^^Y?G[V]{T^, Z,,,l) 



(81) 



(82) 



where A"{z) is the set of admissible controls {ct, 9t) keeping the process Z nonnegative. We 
may rewrite (j82p just in terms of Z . In order to do that, notice that Y^ = a^Hte^^'^* , where 
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is a martingale defined by Hq = 1, dHg = ppaiHsdWs- 



Then, denoting by Q the probability with density process H^, we have that Wt := Wt—ppajt 
is a Q-Brownian motion. Moreover, ()8ip is equivalent to 

(83) 



dZt = -ctdt + Oti^ibL- paiaL{l-p))dt + aLdWtj 
and the control problem can be rewritten as 



Ct'n 



sup E*^ 
(c,e)eA"(z) 



-(/3-fcy,p)s 



U {cs)ds + e' 



-(/3-fcy,p)Ti 



G[V]in,Zr,A) 



(84) 



Due to Subsection 16. H the optimization problem ()83p -(|84 p is now in the framework of this 
paper (as long as we assume that ti has a density). 
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